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Abstract. Let X be a compact manifold with boundary. Suppose that the 

boundary is fibred, <j> : dX ► Y, and let x € C°° (X) be a boundary defining 

function. This data fixes the space of 'fibred cusp' vector fields, consisting 
of those vector fields V on X satisfying Vx = 0(x 2 ) and which are tangent 
to the fibres of <j>\ it is a Lie algebra and C°°(X) module. This Lie algebra 
is quantized to the 'small calculus' of pscudodiffcrcntial operators ^^(X). 
Mapping properties including boundedncss, regularity, Fredholm condition and 
symbolic maps are discussed for this calculus. The spectrum of the Laplacian 
of an 'exact fibred cusp' metric is analyzed as is the wavefront set associated 
to the calculus. 



Introduction 

Algebras of pseudodifferential operators can be used to investigate local regular- 
ity of solutions to partial differential equations and to relate such local matters to 
more global properties. On a compact manifold with boundary there are a number 
of different natural algebras of pseudodifferential operators which generalize the 
'standard' algebra of pseudodifferential operators on a compact manifold without 
boundary. Amongst these are the calculus of b-pseudodifferential operators [ [Tl| 
(b=boundary), Jl^l, the scattering calculus Q and the uniformly degenerate cal- 
culus (or zero) (?] and ||. The distinction between the terms 'calculus' and 'algebra' 
is not great here. The former is preferred because all of the algebras we discuss have 
natural, and useful, extensions to somewhat larger spaces of operators in which not 
every pair of elements can be composed. If the manifold has more structure, for 
example if its boundary admits a fibration, then there are other possibilities, such 
as the edge calculus || which interpolates between the b and uniformly degenerate 
calculi. In this paper we shall discuss another algebra of this general type; it is 
associated to a fibration of the boundary and a choice of boundary defining func- 
tion up to second order at the boundary, or more precisely to a trivialization of the 
conormal bundle to the boundary over each fibre. The extreme cases, in terms of 
the fibre dimension of the fibration, of this algebra correspond to the 'cusp' alge- 
bra, of operators naturally associated to (finite volume) hyperbolic cusps, and the 
scattering algebra, of operators associated to Euclidean scattering theory. 

The purpose of this paper is to give a concise yet complete treatment of this 
'fibred-cusp' algebra, along with a few of the most basic consequences. More so- 
phisticated applications will be taken up elsewhere. In this introduction we shall 
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give an outline of some of the salient features of the algebra which will be proved 
in full later in the paper. 

Let X be a compact C°° manifold with boundary and suppose that the boundary 
has a smooth fibration 

(1) <j> : dX — > Y, 

where Y is the space of fibres. Suppose also that x € C°°(X) is a choice of boundary 
defining function, i.e. x > 0, dX = {x = 0} and dx ^ at dX. In particular, x 
fixes a trivialization of the conormal bundle to the boundary. Associated with this 
structure is the space of fibred cusp vector fields 

V*(X) = {V e C°°(X',TX)]Vx £ x 2 C ca {X) and V p 

is tangent to Vp£ dX}. 

As shown below, V$(X) is a Lie algebra and C°°(X) module which is projective 
in the sense that there is a C°° vector bundle ®TX over X with natural vector 
bundle map i$ : ®TX — > TX, which is an isomorphism over X° = X \ dX, and is 
such that 

C°°(X;*TX) = i $ oV$(I). 

That is, V*(X) can be naturally identified with C°°(X;*TX). The identifier 
will be used to denote objects which are naturally associated to V$(X). Note 
that V$(X) determines the map <f>, but does not completely determine the defining 
function x. 

There are two extreme cases to keep in mind as a guide to this discussion, 
occurring when <p is one of the 'trivial' (or universal) fibrations. The first is when 
Y = {pt} and the second when Y = dX. In the former case, V<s>(X) determines, 
and is determined by, the defining function x up to the equivalence x' ~ x if 
x' = cx + x 2 g, where c > is constant and g £ C°°(X). This will be called the 
cusp algebra. In the latter case, the Lie algebra is independent of the choice of 
x and is called the scattering algebra. The algebra of pseudodifferential operators 
associated to it is discussed in [Ell and [Ell and in local form on 1" goes back at 



least to Shubin |22 . When X is the upper half-sphere, the interior of which may 
be identified with M™ via stcrcographic compactification M™ c — > the scattering 
algebra is generated by the translation-invariant vector fields. 

Since V$(X) is a Lie algebra and C°°(X) module it is natural to consider the 
enveloping algebra, Difi%(AT), consisting of those operators on C°°{X) which can be 
written as finite sums of products of elements of V$(X) and C°°{X). It is filtered 
by the subspaces Diff <J) (X) which have elements expressible as sums of products 
involving at most k factors from V<s>(X). Let ^T*X be the dual bundle to ®TX 
and let p k (®T*X) C C°°(*T*X) be the space of functions which are homogeneous 
polynomials of degree k on the fibres. The principal symbol map extends from the 
interior to cr #ife : DiS%(X) — > P k (' 1 'T*X). This map is multiplicative and gives a 
short exact sequence delineating the filtration 

(3) — > DiffJ-^Jf) ^ Diff|(X) ^ P k {*T*X) — » 0. 

We microlocalize this algebra of differential operators to obtain the filtered alge- 
bra of fibred-cusp, or <!>-, pseudodifferential operators 

Difit(X) C *i{X) 
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where ^^(X) is defined for each m £ R. Again there is a multiplicative symbol 
map delineating the filtration 

(4) — ► ^\X) >-+ $%(X) ^5 S m {*T*X)/S rn - 1 {' s, T*X) — ► 

where S m (E), for any vector bundle E, is the space of symbols of order m. The 
construction of (X) is effected geometrically. More specifically, these spaces of 
operators are characterized by the regularity properties of their Schwartz' kernels. 
These, in turn, are defined as conormal distributions on a space, X%, which is 
a resolution of X 2 . This resolution is obtained from the ordinary 'double space' 
through a sequence of blow-ups. One of the main facts about ^f^(X), that it is 
closed under composition, is proved using a resolution X^ of the ordinary triple 
space X 3 , as we shall explain later. 

Whether a particular element in \t %(X) acts as a Fredholm operator, say on L 2 , 
is no longer determined solely by the invertibility of its image under the symbol 
map (H|) or (Q). In fact, there is a second symbol map, the range of which is in 
general no longer a commutative algebra. To introduce this normal operator, we 
first describe the space of operators in which it lies. 

If F is any compact manifold without boundary and W is a real vector space, 
then the space ^ m (F x W) of all pseudodifferential operators on the C°° manifold 
F x W is well defined. This is not an algebra because we have imposed no growth 
restrictions on the kernels. A special subclass consists of those elements which are 
invariant under translation in W, and therefore loosely speaking act by convolution 
in the W factor and as ordinary pseudodifferential operators in F. Now consider 

(5) *Z s (w)(F)c* m (FxW) 

consisting of those translation invariant operators with convolution kernels on F 2 x 
W which are rapidly decreasing with all derivatives at infinity. These spaces form 
a filtered algebra in the usual way and we call them the W-suspended pseudo- 
differential operators on F\ even though they act on functions on F X W. They 
are invariant under diffeomorphisms of F and linear transformation of W. This 
means that we can define ^"^(^-^(-^'i W), where <f> '■ X' — > Y is any fibration, 
W — ► Y a vector bundle, and G = X' Xy W the fibre product, where elements 
are defined as in (^) on the fibres of G and depend smoothly on the base variable 
in Y. 

If 4> : dX — > Y is the fibration (g), and t $ : *TI — > TX is the natural 
inclusion map, set 

(6) ^NpdX = *T p X, p e dX; t^{v) = 0} . 

Although this is defined as a bundle over dX, in fact it is the lift to dX of a bundle, 
^NY, over Y, 

(7) *NdX = cj)*{*NY), 

and hence is of the form just described. The normal homomorphism, which we will 
define later, takes values in the corresponding space of suspended operators, and 
there is a multiplicative short exact sequence 

o — > xvs(x) - n n P0 ^ *Zs ( *NY)-*( djr > °- 

The symbol and normal operator together are sufficient to capture the Fredholm 
property for these differential or pseudodifferential operators. 
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Theorem 1. An element P £ 'I'^(A) is Fredholm as an operator on L 2 (X) if and 
only if it is fully elliptic in the sense that its symbol cr^o is invertible and in addition 
its normal operator 7V$(P) is invertible as an element of^^^j^y^^dX). 

We will state and prove a more general result for pseudodifferential operators of 
any order acting on sections of a vector bundle. This raises the following funda- 
mental 

Problem 1. Find an explicit index formula for fully elliptic $ -pseudodifferential 
operators in terms of the symbol and normal operator. 

This has been done in full generality in only one case, where Y = dX, i.e. for 
the scattering calculus. This is discussed briefly in |l7|, where it is reduced to the 
Atiyah-Singer theorem. In the other extreme case, where Y = {pt}, the calculus is 
essentially that of manifolds with cylindrical ends. The index theorem in this setting 
for Dirac operators is that of Atiyah, Patodi and Singer jj]. There is a somewhat 
non-explicit index formula for general fully elliptic pseudodifferential operators here 
due to Piazza pQ| . In [ [To] a definition of the eta invariant in this context is given, 
and jl8| contains an index formula in terms of it. 

Beyond these index questions, another reason for developing these calculi of 
operators is to analyze the regularity of solutions to related differential equations. 
We formalize this process using the notion of a wavefront set, which is defined by 
microlocal invertibility properties of ^-pseudodifferential operators. In the analytic 
category the wavefront set (singular spectrum) was introduced by Sato, see pi] ]; in 
the C°° category it is due to Hormander Q. 

To describe this consider again the structure bundle *TA and its dual *T*A. 
The stereographic compactification of a vector space to a ball, or half-sphere, is 
linearly covariant, and so we can define the fibrewise compactification any vector 
bundle. Since X is a manifold with boundary the compactification ®T*X is a 
manifold with corners up to codimension two. The restriction to the boundary of 
the bundle *T*A has as quotient ^N*dX which is, as noted above, naturally the 
lift of a bundle *A*Y" over the base Y. This is the parameter space for the normal 
operator. The disjoint union of the part 'at infinity' of the bundle * T*X and the 
compactification, *iV Y. 

C* = *S*X U *N*Y, 

is the carrier of the <E>-wavefront set 

WF # (tt) = WFl U WF| c Gj.. 

It has properties and utility similar to the usual wavefront set. 
The authors thank Andras Vasy for helpful comments. 

1. Fibred cusp algebras 

We begin our more detailed discussion by analyzing the space of vector fields 
defined by (||). Thus, A is a compact C°° manifold with boundary and as in ([!]), 
is a fibration of the boundary. If the boundary is not connected we denote by Mi (A) 
the set of boundary components. Then each boundary hypersurface H £ Mi (A) 
has a specified fibration 4>h : H — > Yh- There need be no relationship between 
these fibrations. For the most part we shall simplify the discussion by supposing 
that dX is connected, but when confusion might arise in the general case we make 
a precise statement. 
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In addition to the fibration, we also suppose that a boundary defining function 
x G C°°(A) is given. As will be discussed shortly, the structure we describe does not 
depend on all the information in x. Consider V$(A) defined by (||) which should 
now be written more carefully as 

V*(X) = {V eC°°(X;TX);Vx G x 2 C°°{X) and V p 

is tangent to ^ (<f>{p)) V p G H, V H G Mi (X) } . 

Lemma 1. Suppose p G <9A and t/i, . . . , yj> are local coordinates in Y near 4>{p). Let 
j/i, . . . ,yi G C°°(A) be functions satisfying yj — <j)*{yj) on dX near p and choose 
k = n — £ — 1 functions z\, ■ . . , Zk such that x, y~j, Zi give local coordinates in X . 
Then near p, V$(A) is spanned by 

(1 1) x 2 — x— — 

dx ' djjj ' dzi 

Proof. Since the differentials of x and the yj must be independent at p there do 
indeed exists functions z; completing them to a coordinate system. A general vector 
field on X is locally 

i~l iC i~» r\ 

dx 1 Qy. Z-~i % Q Zi 

j — l J i—l 

for C°° coefficients a, bj, Ci. Then Vx = a, so the first condition on V in (Q) is that 
a = 0(x 2 ), i.e. a = x 2 a' with a' C°° near p. Locally the fibres of 4> are the surfaces 
y =const, in x = 0. Thus if V G V$(A) then &j = This shows that the elements 



in ([□]) span V$(X) locally over C°°(A). □ 

Lemma |^ actually shows that V$(A) is projective, and this means that we can 
interpret this space of vector fields as the full set of sections of some vector bundle. 
For any p G X let T p {X) C C°°(X) be the ideal of functions vanishing at p. Then 
denote by X p - V$(A) C V*(A) the finite linear span of products, aV, for a G 1 P {X) 
and V G V$(A), and set 

*r p x = v*po/v V*(X). 

Lemma 2. for eac/i *T p X is a vector space of dimension dim A, and the 

disjoint union 

*TX = |J *T p A 

has a natural structure as a smooth vector bundle over X. There is a natural linear 
map t p : *T p A — > T p X which is an isomorphism when p G X° = X\dX; these 
maps define a smooth bundle map l : *TA — > TX with the property that for every 
V G C°°(X; *TA) f/iere is a unique V G V*(A) C C°°(A;TA) suc/i i/iai 

Conversely, each V G V$(A) defines a section V G C°°(A; *TA). 

Proof. Over the interior of A the elements of V$(A) are unconstrained, and so 
*T p A = T p A for p G A°. We write this identification as b p : *T p A — > T p X. 
Near a boundary point p we have shown that V G V$(A) has a unique smooth 



decomposition in terms of the vector fields (1.1). Thus V G T. p ■ V*(A) if and only 
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if its decomposition has coefficients vanishing at p. This means that (the residue 
classes of) x 2 -^, x-gijp and give a basis of ®T p X, and therefore this vector space 

has dimension dimX. In fact, these sections clearly give ®TX the structure of a 
vector bundle near p, where any smooth section is (locally) given by an element of 
V$(X) and conversely. It remains only to show that this vector bundle structure is 
independent of the choice of the local coordinates. This follows simply by inserting 



the change of coordinate formula for vector fields into the basis (1.1). □ 



Generally we shall ignore the map i and identify V$(X) with C°° {X;^TX) as 
this lemma permits us to do. As noted in the introduction 

Lemma 3. The space V<s>(X) is a Lie subalgebra of C ca {X\TX). 

Proof. If V, W 6 V$(X), then by definition they are tangent to the fibres of <p 
in dX . Because tangency to a submanifold persists for commutators, [V, W] also 
has this property. Similarly, since Vx — x 2 a and Wx = x 2 b for some functions 
a,beC°°{X), 

[V, W]x = V(Wx) - W(Vx) = V(x 2 a) - W(x 2 b) 

= x 2 {Va - Wb) + 2x(a -b)(V- W){x) = x 2 {Va - Wb) + 2x 3 (a - b) 2 . 

□ 

As noted above, the algebra V<j,(X) is determined by cf> and the choice of a 
boundary defining function. Conversely, V$ determines <f> but it does not completely 
determine x. In fact two boundary defining functions x and x' determine the same 
Lie algebra V$(X), and hence the same 'boundary structure' relative to <f>, if and 
only if x' = ax, with a\ dx € <j>*C°°(Y). Thus if we let Cf{X) C C°°(X) be the 
space of smooth functions on X which are constant on each leaf of </> at the boundary 
then this means x' E xC°f{X). 

The Lie algebra V$(X) has a natural ideal, consisting of those elements which 
vanish at the boundary as vector fields in the usual sense. In terms of the basis 
(fbl|), it is spanned by x 2 d x and xdy j and xd Zi near each boundary point and is 
unconstrained in the interior. Over the boundary it spans the subbundle (^|). This 
ideal is the span over C°°(X) of a smaller subalgebra 

(1.2) VUnpO = {V e V$(X);V S xC°°{X,TX) and Vx G xC^(X)}. 

This latter condition is clearly independent of the choice of x defining V$(X), i.e. 
W$(X) is an invariantly defined subspace of the latter. Since W$(X) is a C^{X)- 
module (and not a C°°(X) module) the subbundle of ^TgxX it defines is naturally 
the lift of a bundle from Y. This is the bundle *NY in 

There is a direct representation of the fibre ®T* X, p G dX, of the dual bundle 
which is useful later. For p 6 dX let I P {X) C C™(X) be the ideal of functions 
vanishing on the fibre through p and J P (X) C I P (X) the smaller ideal of functions 
with restriction to 4>^ 1 (p) vanishing to second order at p. Note that I P (X) only 
depends on the fibre through p but J P (X) depends also on the location of p within 
this fibre. If x is an admissible boundary defining function then there is a canonical 
isomorphism 

*t;x = x- 1 c^(x)/x- 1 j p (x) 



given by applying V £ V<t>(X) and evaluating at p; this follows from (1.1) 
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Let Diff$ (Jf) be the space of operators on C°°(X) generated by C°°(X) and 
products of up to to elements of V$(X). The local structure of these operators is 
easy to determine. 

Lemma 4. In the local coordinates near a boundary point described in Lemma []|, 
any P G Diff^, l (X) may be written 

(1.3) P= Pa^, q {x,y,z){x 2 D x Y{xD v fD^, D ^ = \^ t - 

a| + l/5|+9<™ 

Conversely, if P G Diff m (X) and this holds in a neighbourhood of each boundary 
point, then P G Diff$ (X). 



Proof. This follows by induction on to. Certainly (1.3) holds when to = 0. In 



general, Diff^ +1 (X) is the span of V*(X) -Diffg(X) and Diff$ (XV Using the local 



representation of V*(X) given by (1.1) and the representation (1.3) for Diff^ (X), 
the same result follows directly for Diff™ +1 (X). □ 



Note that the order of the various factors in ( |l.3| ) is immaterial, because changing 
it would just change the coefficients slightly. The main properties of this space of 
(^-differential operators will be discussed in more detail once we have defined the 
space of $-pseudodifferential operators. 

2. <I>-PSEUDODIFFERENTIAL OPERATORS 

We now turn to the definition of the 'small' calculus of $-pseudodifferential oper- 
ator. These can be thought of as 'symbolic' functions of the vector fields in V$(X) 



in the same sense that, by (1.3), the ^-differential operators are polynomial func- 
tions in these vector fields. Our definition of this calculus is quite geometric; this 
has the virtue that many of the main properties we need to develop, in particular 
the fact that this space of operators is closed under composition, may be proved 
directly and also quite geometrically. 

Following a general 'microlocalization' principle for algebras of this type, the op- 
erators in V$(X) will be characterized by the lifts of their Schwartz kernels from X 2 
to a space X| which is obtained by a resolution process, more specifically by blowing 
up a sequence of p-submanifolds in X 2 . Here the p-submanifolds (for 'product') are 
those around which the manifold with corners has a product decomposition, they 
may be thought of as properly embedded. The point of this geometric resolution is 
that it encodes the approximate local homogeneities of ^-differential operators, and 
so it is natural to define the $-pseudodifferential operators by requiring that their 
Schwartz kernels also have the same approximate local homogeneities, i.e. lift to 
well-behaved distributions on X|. We refer to ||, j| and Q for a discussion 
of the process of blowing up a p-submanifold in a manifold with corners. 

As already noted, all our constructions proceed independently at each boundary 
hypersurface of X, and so it is sufficient to suppose that dX = H is connected. 

The Schwartz kernel of any operator on C°°(X) is a distribution on X 2 . Of 
course, we are particularly interested in the behaviour of these operators, and hence 
kernels, near the boundary. We use the notation 

L{H) = H x X, R(H) = X x H 

or simply L, R when H is understood. For any manifold with corners Z, let Mk(Z) 
denote set of boundary components of codimension k. In particular {L, R} = 



X 
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Mi(X 2 ). Because X is a manifold with boundary, X 2 has boundary components 
only up to codimension two. Amongst these, only the faces B(H) £ M2(X 2 ), 

B = B(H) = H x H C X 2 , 

which are the ones intersecting the diagonal, are of interest to us. The other 
manifold of primary importance in this discussion is the diagonal 

D = {(z,z)eX 2 }. 

An important feature of this geometry is that these submanifolds do not intersect 
normally. We resolve this by blowing up B to get the b-double space 

(2.1) X 2 = [X 2 -B]- 2 : X 2 -^X 2 . 

This compact manifold with corners is obtained by taking the disjoint union of 
X 2 \ B and the inward-pointing spherical normal bundle of B and endowing this 
set with the (unique) minimal C°° structure for which smooth functions on X 2 and 
polar coordinates in X 2 around B all lift to be smooth. 

We next describe the lifts of the submanifolds of X 2 ; we shall use the same letters 
to denote the lifts but add a subscript 'b' when necessary to distinguish between a 
manifold and its lift. 

First, the 'front face' of X 2 , which is produced by the blow-up of B is denoted 

B b = {p 2 )- 1 (B)=SN+B. 

By definition it is a quarter circle bundle over B. In fact, since the fibred-cusp 
structure specifies the 1-jet of a defining function x for the boundary H of X, this 
bundle is naturally trivial over B 

(2.2) B b = Bx[-l,l] s . 

To see this, note that if x and x' are the lifts to X 2 of the given boundary defining 
function from the left and right factors of X, respectively, then NB is spanned by 
d x and d x i. The interior normal bundle N + B is therefore {(p, ad x +a'd x i); a, a' > 0} 



and it is then easy to check that (2.2) follows, if we use s 



a+a' 

Next consider L and R; the inverse images of these boundary faces under f3 2 
contain B b . We define instead their lifts to exclude the interior of the front face: 

L b = cl ( (%)- l (L)\B b ) = cl ( (/3 b 2 )- 1 (i\i?) N 
R b = cl 



where cl denotes the closure. These are boundary hypersurfaces of X 2 and all of 
the boundary hypersurfaces of X 2 have been enumerated, so that 

Mi(X 2 )= |J {L b (H) , Rb (H) , B b (H) } . 

HeMi(X) 

We also define the lifted diagonal 

D b =c\((p 2 )- 1 (D\DnB)) dX 2 . 

As noted earlier, the diagonal itself does not intersect the boundary normally. How- 
ever, D b is a closed embedded p-submanifold, and the only boundary hypersurfaces 
it meets are the diagonal front faces B b {H). In this sense the blow-up of X 2 to X 2 
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resolves the 'geometry' on X 2 consisting of the boundary faces and the diagonal. 
This blow-up is the basis for the direct definition of the b-calculus, see B . 

There are however further degeneracies, associated to the fibred-cusp algebra, 
which need to be resolved. These occur along the fibre diagonal of the front face 
B = H x H, given by 

{(h, h') e B; <j){h) = 4>{ti) in Y}. 
Using the product decomposition ( |2.2| ) this lifts to the submanifold 

(2.3) $ = = {(h, ti, 0) £ B b = B x [-1, 1],; 4>{h) = 4>{h')}, 

which is an embedded, closed submanifold in the interior of Bb, hence is a p- 
submanifold of X 2 . For any manifold with corners Z we denote by Vb(Z) the Lie 
algebra of smooth vector fields which are tangent to each of the boundary faces. 

Proposition 1. The Lie algebra Vb{X) lifts to X 2 from either factor to a Lie 
subalgebra of Vb(X 2 ) transversal to Db- In each case the elements of the lift of 
V$(X) constitute the subset of the lift of Vb(X) consisting of those vector fields 
which are tangent to $. 

Proof. Using local coordinates x, y, z, x' , y' ', z', as in Lemma |l|, on both the left 
and right factors of X, gives coordinates 

(2.4) x', s = X y, y', z, z' in X 2 , 



on X 2 valid near s = 0. The vector fields in (1.1) lift to 



x 



(1 + s)d s 



2x' d d 



2 s ' 1 — s dyj ' dzj ' 

and these are clearly tangent to $ = {x 1 = 0, s — 0, y — y'}. On the other hand, 
the basic generating set of vector fields on V&(X) is 

(2.5) xd x , <%, d Zi ; 

these lift to 

i(l-s 2 )5 s , dy } , d Zj 

which are clearly transversal to Db = {s = 0,y = y' , z = z'}. If such a lift is tangent 
to $ then it is easily seen to be the lift of an element of V$(X). □ 



It follows from (^4) that $ is the flow out of dDb under the lifts of V$(X) from 
the left and right factors. It is therefore the minimal submanifold to which these 
lifted vector fields are tangent. 

In the second (and final) stage of the fibred boundary blow-up we define 

(2.6) Xl = [X 2 b - $], fo_ h , X 2 — > X 2 . 
There is also a full blow-down map 

/3$ = /?$-& o (3b '■ Xl — > X 2 . 

Lemma 5. The Lie algebra V$(X) lifts, from either the left or right factor of X to 
a Lie subalgebra ofVb(Xl). The diagonal D lifts to a closed embedded p- submanifold 

(2.7) D$, =cl/^ 1 (.Dn(X 2 )°) 
and the lifted algebra is transversal to the lifted diagonal. 
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Proof. These statements are all trivial in the interior of X^, , which is diffeomorphic 
to the interior of X 2 . Since all constructions are local near fibres of (f> it suffices to 
consider the model product fibred-cusp structure 

X=[0,l) x xY y xF z . 

Near its front face, X 2 is also a product 

(2.8) Xl ~ [-1, 1], x [0, l) x+x , xY 2 x F 2 . 

The boundary fibre diagonal is the submanifold 

$ = {0} x {0} x Diagy xF 2 . 



The second blow-up occurs only in the first three factors of (|2.£ ). This effectively 
reduces the problem to the case F = {pt}. In the first blow-up, (2.1), if r = x + x' 
then 

1 ,1 - - 

x=-(s- l)r, x = -(1- s)r, 



2 y ' 2 V ' x + x' 

As noted in Proposition [I], the basis fields (1.1) lift smoothly to X 2 as 



x 2 d x — » J(l + s) 2 r 2 d r + + S ) 2 (l - s)rd s 



xd Vj ' — > ^( 1 + s ) rd iir 



1 

2 ( 

Since the lifts of smooth coefficients are smooth, we can instead consider near $ 
the simpler basis 

(2.9) r(rd r + (1 - a)8.), rd § ., 

which also spans the lift of V<s>(X) over C°°(X^). 

Since these vector fields are tangent to $ = {r = 0, s = 0, y = y}, they lift 
smoothly under the blow-up of <&. Near the lifted diagonal the variables r, S = s/r, 
Yj = (Vj ~ y'j)/ r gi ye local coordinates and in terms of these the vector fields in 
( ]2~9| ) become 

r 2 d r - rSd s - rY ■ dy + (1 - rS)d s , d Yj ■ 

Since the lifted diagonal itself is {S = 0, Y = 0}, this shows that the lift of V<s>(X) 
from the left factor (and hence by symmetry also from the right factor) is transversal 
to the lifted diagonal □ 

Notice that Dg, ~ X, with the diffeomorphism given by n o The transver- 
sality in Lemma JH] shows that there are natural isomorphisms from the normal 
and conormal bundles of D$ in X| to the ^-tangent and cotangent bundles of X 
covering this identification, 

*TX ~ ND&, *T*X ~ N^D^. 

Now that X%, has been defined, we consider the structure of the lifts of the 
Schwartz kernels of ^-differential operators to this space. The fundamental case to 
understand is the identity operator. In local coordinates its Schwartz kernel (on 
X 2 ) is 

K u = 5{x - x')S{y - y')8(z - z') dx'dy'dz' 
=> u(x,y, z) = / Kjdu(x',y',z'). 
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From now on we identify this distribution with the operator K\ c \ = Id . It is more 
convenient to write it in terms of a '<I>-density' (x')~^ +2 ^ dx' dy' dz' where I = dimy : 

Id = (x'Y +2 S(x - x')5(y - y')S(z - z')v' 9 

t/ 9 = (x')- e - 2 dx'dy'dz'. 

Consider its behaviour when lifted from the interior of X 2 to X 2 . It is supported 
on the diagonal D, so it suffices to consider a neighbourhood of {s = 0} in (2.7). 
Since x — x' — rs and x + x' — r, ( 2.10| ) becomes 

Id = r f+1 (l - sY+ 2 d(s)S(y - y')5(z - 

Because (1 — s)S(s) = S(s), the factor (1 — s) t+2 may be dropped. 

Next, consider the lift from X 2 to X^,. Of course, the support of Id is contained 
in the ^-diagonal D§. In terms of the coordinates r, S — s/r, Y = (y — y')/r valid 
near _D$ (along with y' , z, z') we have 

(2.11) ld = S(S)5(Y)6(z-z')f3*M). 

The density factor is simply a smooth, non vanishing, section of the lift from the 
right factor of the density bundle x~ l ~ 2 dx dy dz; that is of the $ density bundle. 

For any embedded p-submanifold M in a manifold with corners X, the smooth 
5-functions on M are the elements of a space 

V°{M) =C°°{X)-n 



where /i is any non- vanishing 5- function with smooth coefficients, as in ( 2.11 ). The 
delta functions of order at most k are obtained by differentiation 

v k (M) = ms k (x) ■ n. 

In fact it is only necessary to differentiate across M. Thus if V is any Lie algebra 
of smooth vector fields which is transversal to M, in the sense that for any section 
of T M X/TM = NM there is an element of V which projects to it along M, then 

V k (M) — ^ V J • \i. 

j<k 

By Lemma [| lifts to X| to give such a Lie algebra transversal to . Thus 
(2.12) P fe (^4>)®^ =Diff|-Id. 

The choice of initial smooth density on M is of course irrelevant; moreover, since it 
is in the right factor, the differentiations on the right in (2.12) do not affect it. The 
space on the right here is, by definition, the space of Schwartz kernels of Diff $ (X), 
and so we conclude 

Proposition 2. The Schwartz' kernels of the elements o/Diff^(X) lift to X$ to 
be precisely the space V k (D^,) ■ v'^ of all smooth 5-functions on D<s> up to order k 
with a right $ -density factor. 

This result can be extended directly to operators on other bundles. Thus if E 
and F are vector bundles over X then D\S\{X\ E, F) consists of all the differential 
operators from sections of E to sections of F which are given by matrices with 
elements in Diff^,(X) in local trivializations. It follows that 

Diff|(X; E, F) = C°°(X; F) ■ Diff|(X) • C°°(X; E*). 
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The space on the right here is the finite linear span of (ordered) products of elements 
from each of the three component spaces, hence is simply the tensor product over 
C°°{X). If Hom(.E,F) is the bundle over X 2 with fibre hom^, F p /) = E* ® F p > 
at (p,p') then it is also true that 

(2.13) Diff|(X; E, F) = V k (D^) ■ C°°{X%\fc Hom(£, F) ® *n') 

= V k {Dz) ■ PlC°°(Xl ; Hom(£, F) ® *fi'), 

where *f2' is the lift of the <&-density bundle from the right factor. 
This gives the following normalization. 

Corollary 1. The lifts to X% of Schwartz kernels of elements of DiS^,(X; E, F) 
coincides with the space 

(2.14) T> k (D<f,) ■ C°° (X 2 :Hom(E;F) ® . 

On a manifold without boundary this identification of the kernels of differential 
operators becomes 

Diff fc (X'; E.F) = V k (D) ■ C°° (X 2 ; Uom(E; F) ® il') , 

where again fi' the density bundle lifted from the right factor. To obtain the space 
of pseudodifferential operators in the boundaryless case, one replaces T> k (D), which 
is the space of polynomials in all smooth vector fields, by I k (X 2 ,D), the space of 
conormal distributions, which may be thought of as symbolic functions of these 
vector fields. Clearly 

V k (D) C I fe (X 2 ,L>), 

and in fact, V k (D) may be characterized as that subspace of conormal distributions, 
whose elements have supports contained in D. 

Although conormal distributions are initially defined with respect to submani- 
folds of the interior, which do not intersect the boundary, we may define conormal 
distributions with respect to any interior p-submanifold, simply by requiring that 
they extend across the boundary as conormal distributions for some (hence any) 
extension of the submanifold. Thus I k (X| , D$ ; G) is defined for any vector bundle 
G over Xj, and its elements are smooth outside D^>. Letting = denote equality 
in Taylor series we define the microlocalization of DiS^(X) (or V$(x)), to be the 
following space of $-pseudodifferential operators: 

Definition 1. For any m S M the space of $-pseudodiffcrcntial operators of order 
m (in the small calculus) is 

(2.15) 9%(X;E,F) = {K G I m {X 2 ,D^f3l (Hom(i?; F)) <g> ; 

X = 0at dX 2 \S{X 2 )}, 



where ff(X|) is the front face produced by the blow up (2.5). There is some 
ambiguity in the definition of I m , depending on whether symbols of type 1, or the 
smaller space of 1-step polyhomogeneous (i.e. classical) symbols are used. When 
absolutely necessary, we shall denote the polyhomogeneous space by 

(X;E,F) C*%(X;E,F). 

Generally the statements we make are valid with either interpretation of I m . 
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3. Action of <I>-pseudodifferential operators 
Combining Corollary |l| and Definition [l] we have 

(3.1) Diff|(X; E, F) C E, F) V k E N 

as sp aces of kernels. We wish to interpret these Schwartz kernels as operators so 
that djlj) still holds. 

For simplicity take E = F = C. Then the spaces in (2.14) and (2.15) can be 
rewritten as 

V k {D^)-C^{X 2 ;l3*^n')) 
I m (Xl,D*)-C£(X 2 ;Pl*n'), 

respectively, where C^{X 2 ; is the space of sections vanishing to infinite 

order at all boundary faces except fi.(X%). 

Consider the lift of a non-vanishing density from X to the left factor of X 2 and 
then to Using the diffeomorphism which exchanges factors, the computation 
leading to ( p. 14 ) shows that the tensor product identification p^Jl ® = ^ 

extends from the interior of X 2 , and so of X§, to give an isomorphism of spaces of 
sections 

(3.2) Cg° (Xl;Pl(plQ ® p* R *n)) = C^(X 2 ;fl). 

That is, the singular Jacobian factors arising all occur at faces other than ff (X$) and 
have finite order singularities, which are absorbed by the infinite order vanishing 
at these faces. 

Fixing any < v E C°°(X; fi), the action of P E Diff|(X) on u E C°°{X) can 
then be written 

Pu-v — (itl)*{P ■ k* l v ■ ir R u) 



where (3.2) is used to identify the product on the right as a density on X% and 
ttl = pL ° /3$- Generalizing from this, we see that in order to define the action 
of $-pseudodifferential operators it suffices to establish the following result about 
push-forward: 

Lemma 6. Push-forward to the left factor defines a continuous linear map 

(tt l ), : I m {X 2 , £> $ ) • 6§>(Xl; fi) — ► C°°(X; fi). 
and hence using ( |3.2| ) 

(3.3) (tt l ), :I m (X 2 ,D^-C^(X 2 ;f3lTT R ^n) — *C°°(X), 

Proof. This is a special case of the push-forward theorems discussed in |l3"| . To 
apply these theorems, we need to know that ttl and tt r are b-fibrations, and this 
is established below. The singularities of the kernel of D$ are integrated out since 
7T£ is a smooth map which is transversal to the lifted diagonal. This transversality 
follows from Lemma || which shows that the lift of V$(X) from the right factor 
is transversal to D$ and spans the null space of the differential of ttl. From the 
general properties of conormal distributions 

(n L ), :I m (X 2 ,D^)-C^(U;n) C°°(X) 
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if U is a small neighbourhood of the diagonal. For such a neighbourhood (17) C 
C^°(X|,) so it suffices to consider the case m — -co, i.e. to show that 

(3.4) (tt l )* : CjfpfJ,; 0) — ► C 00 ^; fl). 



Notice that (3.4) is not quite trivial since it is not the case that (ttl)* maps 
C°°{Xl;tt) into C°°(X;ft). As discussed in @ a result such as (|1]) follows from 
two facts 

ttl is a b-fibration and if 6 M\{X) then 
7r^ 1 (7J) n ff is a boundary hypersurface of X|. 

The second condition here just means that / G Cg'(X^) vanishes to infinite order 
on all of 7r^ 1 (iJ) except for the one boundary hypersurface, which is the front face 
corresponding to H in ( |2.5| ) . 

Thus it is only necessary to show that ttl = Pl ° /3* is a b-fibration (for the 
definition of this and other terms here we refer to Q). Both pi, and /3$ are 
surjective b-maps and b-submersions, and so ttt, is also a b-submersion. It remains 
only to see that no boundary hypersurface of X^, is mapped into a boundary face 
of codimension two or more in X, but since X does not have any such faces this is 
automatically the case. □ 

Tensoring with the general coefficient bundle we deduce the elementary mapping 
properties of $-pseudodifferential operators. 



Propositions. Using the identification ( |3.2| ) ; each element A S ^^{X; E, F) 
defines a continuous linear operator 

(3.5) A:C°°{X-E) — >C°°(X;F) 

which restricts to A : C oc (X;E) — > C°°(X;F) and extends by continuity in the 
distributional topologies to 

A : C-°°(X; E) — ► C-°°(X; F) and 

(3.6) 

A:C-°°{X-E) — >C-°°(X;F). 
These actions are consistent with the inclusion ( |3.l| ). 

Proof. The discussion above proves ( |3.5| ), since any element can be decomposed as 
a finite sum of products 

Wl l (X;E.F) = C°°(X;F) ■ V£(X) ■ C°°(X; E*). 

That Au G C°°(X;F) if u G C CC {X;E) follows from the observation that if <p G 
C°°(X) and ueC°°(X;E) then 

P{4>u) = (w* R <p ■ P)u 

where, directly from Definitiong, tt* r ^-P G V%(X; E, F ) if P G V%(X; E, F). Now, 
if u G C°°(X;E) it can be written as a finite sum, u = J2j 4>j u ji u j £ C oc (X;E) 
and G C°°(X). 
If G C°°(X) then 

^■C£{Xl)dC°°{Xl)- 
the extra vanishing at ff (X^,) comes from the first factor. From this it follows that 

nl{x~ k ) ■ **R<i>P G (X\ E,F)V fc G N, V <f> G C°°(JC), 
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hence i^Pu e C°°(A; F), i.e. Pu G C°°(A; F). 

Again from Definition the formal adjoint of P G ^^(X; F, F) with respect to 
smooth inner products on E and F and a density on A is an element of $ $ (X; P, P) . 
Thus the mapping properties (|3.6|) follow by duality. □ 



The singular function x/x' on X 2 , where x G C°°(A) is a boundary defining 
function on the left factor and x' is the same function on the right factor, lifts to 
be C°° up to the interior of the front face of X 2 , and hence up to the front face of 
X£. Since it has only a finite order singularity at the other boundary hypersurfaces, 
/3$(x/x') is a multiplier on ^>^(X;E,F), This means in particular that 

P a : C°°(dX; E) — ► C°°(dX; P) 

(3.7) 

PdU = Pu\ dx ,u G C°°(A; E) with u = u\ gx 

is well defined, regardless of the extension u of u. This corresponds to the map 
obtained by restricting an element of (X) to the boundary. Below it is augmented 
appropriately to define the normal operator, which is the boundary symbol in this 
context. Before doing this, however, we first discuss the ordinary symbol map for 
$-pseudodifferential operators. 

For conormal distributions the symbol map 

I m (X;G) 2* S lm \N*G;ni(N*G)®ir*{&X)), 
(3.8) x ! 

M = m H — dim X dim G 

4 2 

was introduced by Hormander. ft is normalized on half-densities. Here 

S IM](A) = S M (A)/S M - 1 (A) 

for any conic manifold A, is the quotient. For the case G = P$ C Aj, it has already 
been shown in Lemma || that N*D$ ~ *P*A. The (singular) symplectic form on 



*P*A trivializes the bundle *f2 = x 1 2 il so (3.8) leads to the desired map 
(3.9) tr* ifn : *£(A; P, P) — » S [m] (*P*A; ir* hom(P, P)). 

This generalizes the symbol map for differential operators obtained by taking the 



leading part of (1.2) as a polynomial on *T*X. It gives a short exact sequence 

► ^l l -\X;E,F) <-+ *™(A;F,F) ^5 S [m] (*T*A; vr* hom(P, P)). 

For the polyhomogeneous spaces, ^^(A; P, P) the symbol becomes a homogeneous 
section of hom(P,P) lifted to *T*A\0. Letting Z = *S"*A be the boundary 'at 
infinity' of the radial compactification * P*A this allows the symbol map to be 
written 

CT p $, ro : *™$(A; P, P) — » C°°(Z; (A*Z) m ® ^* hom(P, P)), Z = *S*A. 

Next let us note how the action of $-pseudodifferential operators can be written 
locally. 

Proposition 4. If x G C°°(A) /las support in a coordinate patch, U, based at a 
boundary point p G 9 A ™£/i coordinates x, y, z as in Lemma ^ i/ien i/ie localized 
action of P G (A) on u e C^°(U) takes the form 

(3.10) xPu = J P x [x,y,z,S,Y,z-z')v{x(l+xS),y-xY,z')dSdYdz' 
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where v(x,y,z) is the coordinate representation of u and the kernel P x is the re- 
striction to U x WL N of a distribution on R" x R"- k x R k which has compact support 
in the first and third variables, is conormal to {S = 0, Y = 0} x {z = z'} (which is 
the origin in the second two factors) and is rapidly decreasing with all derivatives 
as \(S, Y)\ — ► oo. 

Proof. The kernel of the localized operator can be taken to be x^X- Any part of 
the kernel, on X$, away from £>$ and ff(X|) is smooth as a function on X 2 and 
vanishes rapidly at the boundary. Localizing on X\ this gives a smooth section of 
Kom(E, F) ® TTftLu over X 2 vanishing rapidly at both boundaries; such a term can 
be written in the form ( [3.10 ) with P x both C°° and rapidly decreasing in S and Y. 



Thus we can suppose that the kernel has support in a small neighbourhood of 
D<j, U ff(X|). The part in the interior has a conormal singularity at the diagonal 
and, since x,x' =fc 0, can again easily be written in the form ( 3.10] ). Thus we can 



suppose that the kernel has support in a small neighbourhood of S(X^). Suppose 
initially that its support only meets the interior of ff (X\). In this region x, y, z, S 



7T 



, Y = ^— ^ and z' gives coordinates on X%. Thus ( 3.10 ) results by introducing 



x' = x(l + Sx), y = y' — xY. The kernel has compact support and only a conormal 
singularity at S = 0, Y = 0, z = z' so ( 3.10Q results. 



The final term then is a smooth contribution to P supported near S(X^) and 
vanishing to infinite order at the other boundary faces nearby. Although the coordi- 
nates x,y, z, S,Y, z — z' are not valid up to these adjacent boundaries a smooth func- 
tion vanishing in Taylor series in this sense just corresponds to a Schwartz function 
in the variables S,Y, i.e. rapidly decreasing with all derivatives as \(S, Y)\ — ► oo. 



This proves the local representation (3.10). □ 



This proposition does not quite give a complete local description of the action 
of P. However, if p, p' € dX lie in the same fibre of <fi then <fi(p) = <j>(p') lie in some 
coordinates patch in Y . Thus one can take 'consistent' coordinates near p and p' 
given by x, y, z and x, y, z respectively. The same argument as in the proposition 
gives a representation 

(3.11) xP u — J P x (x,y,z,S,Y,z)v(x(l + xS),y — xY,z')dS dY dz 

where x S C^°(X) has support in the coordinate patch near p and v has support 
in the coordinate patch near p'. The localized kernel P x is smooth in all variables, 
compactly supported in x, y, z and z' , and is rapidly decreasing with all derivatives 
as \{S,Y)\ — ► oo. 

Other pieces of the kernel correspond either to points p,p' in different fibres 
over the boundary or where either, or both, of the pair lie in the interior. In 
these regions the localization of the kernel is a smooth section of X 2 , except for a 
conormal singularity at the diagonal, and with rapid vanishing at any boundary. 

The front fact of X 2 , is a bundle over dX with fibre (/> _1 (y) 2 x ^NyT over y. The 
singular variables Y = (y — y')/x and S = (x — x')/x 2 introduced above give linear 
coordinates in ®NyY, depending on the choice of admissible coordinates. Under 
a change of such coordinates Y and S transform linearly at x — 0, as a bundle 
transform on * NY, and as Taylor series at x = vary polynomially: 

(Y, S) — » A(y") ■ (Y, S)+J2 x jp 3& w'. Y, S) 
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where the Pj smooth and are polynomials (without constant terms) in the variables 
Y, S. 

4. Normal operator 



Using the representations ( 3.10 ) and ( 3.11 ), we see that the restriction map in 



( p.7| ) is locally represented by 

P d u = / Pd(y, z,z - z')u(y, z')dz' 

(4-1) J 

Pg(y,z,z~z') = J J P x (0,y,z,S,Y,z-z')dSdY. 

This shows 

Lemma 7. The map P i — ► Pg in ( |3.7| ) gives a surjective map 
(4.2) 9%{X;E,F)-»*%(dX;E,F) 

where ^!™(dX; E, F) is the space of pseudodifferential operators acting on the fibres 
of <f> : dX — ► Y and depending smoothly on the base point. 



It is important to note that the null space of ( |4.2j ) consists of those elements 
for which the integral in (4.1) vanishes for all y G Y (and z,z' G F). This is 
closely related to the question of determining which <f>-pseudodifferential operators 
are compact as operators on L 2 (X;E,F). For example, as will be seen below, the 
most obvious class of residual operators, the elements of <I'^ 00 (X; E, F), are not 
all compact. The operators P for which Pg = are also not, in general, compact. 
In fact, such an operator is compact only when the whole of the restriction of its 
kernel to ff(X|) vanishes, not just its fibre average as in ( |4.l| ). 

We examine this issue by means of 'oscillatory testing'. To do this, fix a point 
p G dX, and suppose / G C°°(Y) is real-valued and has df(<p(p)) ^ 0. Choose 
/ e C°°(X), also real- valued, with / \ dX = 4>*f. Finally, take X & C°°(X) such 
that 

X = l near cf>^ 1 ((f>(p)) 
df^O on 0(suppxn<9X) 
and consider the 'oscillatory test section' 

u f =e i f/ x X u, u^C°°{X- : E). 

Lemma 8. For an 'oscillatory test section' of this form, and for any operator P G 

(4.3) P(e lf ~ /x X u) = e l ~ sjx Pu 
with P G ^l l (X;E,F). 

Proof. The kernel of P is e~ l ^ x Pe 1 ^ l x %' ■> using the obvious notation for variables 
and functions lifted from the left and right, respectively. It will suffice to show that 

the lift of e- lf ~ /x X e lf ' /x 'x' is C°° on the union of (X 2 ) 

(4.4) . ' 
and (ff(Xj,))° and multiplication by it preserves Cg?(Xj). 

Recall that the space in the final statement here consists of the smooth functions 
on X$ which vanish to infinite order at all boundary faces except ff(X|). The 
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main point is to demonstrate the smoothness up to the interior of ff(A|,). First set 



x 1 = (1 + s)x, corresponding to the blow up (2.1), so that 



1 = + g(x, y, z) — . 

XXX X 1 + s 

Clearly we may restrict attention to the singular part 

f(y) fig) _ m M ~ *Y) 

x x' x (1 + xS)x 

Using a Taylor expansion and the fact that d y f ^ on suppx, we see that this is 



C°° up to x = as a function of (S, Y) £ R 1+k . This proves the first part of (fO|); it 
also shows that this function has singularities only of finite order at all boundaries 
of X| besides ff(X|). It is therefore a multiplier on Cg°(X|). In fact, this shows 
that 



'Xe" J lX 'x' is a multiplier on $%(X;E,F), 



and this proves the lemma. □ 



The operator P in (4.3) depends not only on /, but also its extension / and 



the cut off function \. However, the restriction Pq depends only on / and x- This 



follows from (4.1), for if we assume that \ is supported in a coordinate patch, then 



(4.5) P a (y, z,z-z') = J J exp(if(y) ■ Y + if(y)S) 

P x (0,y,z,S,Y,z- z')dSdY. 
As noted in Lemma 0, the y variable enters here only as a parameter. A similar 



formula may be obtained from (3.11), and so we conclude that if xiv) = 1 on the 
fibre (j)~ 1 (y) then for that value of y, Po(y,z,z — z') G '$> m (4>~ 1 (y); E, F) depends 
only on f(y), df{y) and P. 

Lemma 9. If we fix a point (y, rj) G T*Y and a constant r£l, then the indicial 
operator 

P(l/,r,Tj)e* ,n (^- 1 (»);£;, J F) 

is well-defined as the restriction to that fibre of Pq, where P is defined by Lemma^ 
with f chosen so that f(y) = r and d y f{y) — rj. If P{y,T,rj) = for every y,T,rj, 
then P exWg(X;E,F). 



Proof. Only the last statement needs to be checked. From (4.5) it follows that 
if P(y,T,rj) = then the Fourier transform of the kernel on each fibre of ff(X|) 
over Y vanishes, hence P \ ff(A|) = and this is equivalent to the existence of 
Q € &™(X; E, F) such that P = xQ (or equivalently, the existence of some Q 1 with 
P = Q'x'). □ 

As is clear from (4.5), (3.10) and ( |3.11 ) the information carried in the operators 



P as we let y e Y, f{y) — r and r\ = df{y) vary determines the restriction of the 
kernel of P to ff (Aj,). We shall reorganize these individual operators into the family 
of normal operators. Before we may do this, however, we must first describe the 
algebra in which the normal family takes values. 

For any compact manifold without boundary, M, and real vector space, V, M x V 
is a C°° manifold so the spaces 1 i' m (M x V) of pseudodifferential operators on 
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M x V are well defined. These do not compose since the growth of the kernels is 
unrestricted at infinity in V. We consider the subspace 

^us(v)(M)C^ m (MxV) 

consisting of the translation-invariant elements with ^-convolution kernels van- 
ishing rapidly, with all derivatives at infinity. Thus If A e $> m (M x V) then 

if 

AT*u = T*Au V ueC?°(M xV), veV 

(4.6) 

y J and A: CJ°°(M x V) — > C°°(M x V) + S(M x V). 

Here T v (m, w) — (m, w — v) is translation by v and S(M x V) is the Schwartz space. 
The translation-invariance means that the kernel is of the form 

A(m,m',v- v') e C~°°(M 2 x V 2 ;Q R ). 

Then, with some abuse of notation in which A also stands for the ^-convolution 
kernel, the second condition in (|4.6|) means that 



(4.7) A e C-°°(M 2 x V) n R (M x V)) + S(M 2 x V; Q R (M x V)) 

where Qr(M x V) — n R £l, tt r : M 2 x V — > M x V being projection onto the 
right factor of M. 

For the case V — R this is the 'suspended algebra' considered in From (4.7) 
and the general properties of pseudodifferential operators it follows that ^* us (y) (M) 
is an order-filtered algebra of operators 

A : S(M xV) — ► S(M x V). 

The notation here, ^* sus (y){M) , is to indicate that the algebra can be thought 
of as the '^-suspended algebra of pseudodifferential operators on M.' In this sense 
the primary object is M. To have the corresponding algebra of operators acting on 
a vector bundle, the vector bundle should be defined over M and pulled back to 
M x V. Thus if E is a bundle over M then 

Kns(V)(M;E) = * s * us(y) (M) ® C » ( M=) C°°(M 2 ;Hom( J B)) 

defines the algebra of operators 

A : S(M xV;E) — ► S(M x V; E). 

Directly from the definition, ^^/yj {M ; E) is invariant under arbitrary diffeo- 
morphism of M and linear transformations of V, as well as bundle transformations 
of E over M, This allows us to define the more general object we need. 

Definition 2. Let : X' — > Y be a fibration of compact manifolds, E — > X' a 
vector bundle and V — ► Y" a real vector bundle. Then the algebra of V-suspended 
fibre pseudodifferential operators on X', ^"^y^^^iX'; E) is the space of operators 

A : S{X' x Y V;E) — > S(X' x Y V;E) 

which are local in Y and for any open set O C Y over which <f> and V are trivial 
reduce to a smoothly O-parametrized element of ^^(y ^{(f)~ l {y);E). 
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Thus an element A <E ^"^(yj (X';E) has Schwartz kernel of the form 

A(y, z, z', v) e C-°°(X' x y I' x Y V; Rom(E) ® Or) 
+S(X' x Y X' x y V; Hom(£) <g> Or) 

where A is conormal with respect to the submanifold 

D $ x {0} = {(y, z, Z, 0)} Cl'xylXyF 
which is the hbre diagonal. The action of A is given explicitly by 

Au(y,z,v)= / A(y, z, z' ,v — v')u(y, z' ,v')dz'dv' 



since f2# is the lift from the right factor of the fibre density bundle of X 1 Xy^as 
a fibration over Y. 

Since the kernel is essentially a density on the fibres of V when all the variables 
are held fixed its Fourier transform is well defined and is a smooth function of the 
dual variables 

A(y,z,z',w*) = { e- lw '- w A(y,z,z',w)dV. 



For each w* € V* it is a pseudodifferential operator on the fibre <j> l {y). This 
corresponds to the indicial operator in Lemma ||. In fact 

Proposition 5. For a ^-structure on a compact manifold with boundary X, the 
indicial operators of Lemma |] combine to give the Fourier transform of an element 
°i ' ^susiv)-^^-^- ' ^) w ^ lere V — * NY is the null bundle, on Y , of the restriction 
®TqxX — ► TdX and the resulting map, defining the normal operator, gives a short 
exact sequence 

(4.8) — > xn i (X; E, F) — *%(X; E, F) ^ *™ s(v) _ (W; E, F) — > 0. 

Proof. From ((D]) we know that P is the Fourier transform of the restriction of the 
kernel of P to the front fact, S(X$). Thus, at the level of kernels, the map iV$ is just 
restriction to ff This shows that the null space of iV$ acting on ^^(X; E, F) 

is precisely x^^(X; E.F) and directly from Definition [|, N$ is surjective as is 
(O). □ 



When we consider composition below it will be apparent that (4.8) is multiplica- 
tive. 

5. Composition 

It is relatively straightforward, if tedious, to check that the space ^^,(X; E) is an 



algebra by using the local representations (3.1C) and (3.11). Instead we use a more 



conceptual approach that has the virtue of applying in rather general circumstances 



10 1 and in the present circumstances to more general operators (i.e. 'larger calculi' 



with non-trivial boundary behaviour). 

Thus our approach is to define a 'triple $ product' X$ with maps back to the 
double product X\ defined in (2.6). The definition of X| from X 3 proceeds by a 



chain of five blow ups. These are carried out independently at each of the boundary 
faces of X, so for simplicity we generally assume that dX = H is connected. We 
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shall use a notation for the boundary faces of X 3 similar to that used above for 
X 2 . Namely if if £ M{X) then set 

L(H) = H x X 2 , M(H) = X x H x X, R(H) = X 2 x H. 

Thus in general 

Mi(X 3 ) = |J {L(H), M(H), R(H)}. 

HeMi(X) 

For the codimcnsion two boundary faces we are only interested in those meeting 
the diagonal; we use the notation 

S(H) = H x H x X, C(H) = H x X x H, F(H) = X x H x H. 

Here 'S = second', 'C = composite' and C F = first' arise from the relationship to 
the composition of operators. The only codimension three boundary faces meeting 
the diagonal are 

T(H) = H 3 C M 3 (X 3 ), 

the 'triple' faces. In general we drop the reference to H. 

The two stage blow up leading to X 3 resolves the intersection of T, S, C and F: 

(5.1) X 3 = [X 3 ;T;S;C;F]. 

Although there are in principle four blow ups here, after the blow up of T the lifts 
of S, C and F are disjoint p-submanifolds so can be blown up in any order. 

The remaining stages in the definition of involve the blow up of various 
<i>-diagonal submanifolds. To see how these arise, consider the product 

X x Xl = [X 3 ;F]. 



The submanifold $ C X 2 defined in (2.3) therefore defines a submanifold we denote 
(5.2) $ F = X x $ c X x Xl. 

Now T C F so, by the commutativity of blow-up in this setting (see fTpf , [||), the 
order of blow ups can be exchanged to obtain a natural isomorphism 

[X 3 ;F:T}~[X 3 ;T:F]. 

The product structure in ( |5.2| ) and the fact that T lifts to [X 3 ; F] to be 

T' = H x B b {H) C [X 3 ; F] = X x X b 2 , 

shows that <&p has a common product decomposition with T". The inverse image 
of (f>i? in [X 3 ; F; T] is therefore the union of two p-submanifolds which we denote 

f| F = /3 t ,($f) = d.((p r ,)- 1 ($ F \r)) and 

\$ FT = (/3 T ,)- 1 ($ F nT'). 

Neither of these p-submanifolds meets the lifts of S or C to [X 3 ;F, T] so they 
equally well define submanifolds 

iF,iFTCAt = [X 3 ;J F;T;S;C]. 

Of course from the basic symmetry of the set up we have similar submanifolds 

$> s ,$> st ,$c,®ct C Xf. 

Notice that $o C Oj C Xl, O = F, S,C when Ob denotes the front face produced 
by the blow up of O in defining X?. On the other hand $qt C T b for O — F,S, C. 
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Lemma 10. The intersection of any pair of<&sT, $ft and $ct is the submanifold 

$ T = $ ST n $ ft n $ct 
which is contained in the interior ofTb- 



Proof. Let us examine these definitions more closely. Since we only need to consider 

r2 



the ope rations near each boundary, X can be replaced by [0, l) x x H, so X 2 is given 



by (2.8) and in this representation 

$ = {0} x {0} x £>$ 

where D<s> C H x H is the fibre diagonal. Now, X 3 ~ [0, l) 3 x H 3 . So near the new 
faces 

[X 3 ;T] ~ [0,1) x Gx H 3 
X 3 ~ [0,1) x G b x H 3 . 

Here, G C I 2 is an equilateral triangle with centre the origin and Gb is obtained by 
blowing up each corner of it. Thus Gb can be embedded in R 2 as a regular hexagon 
with centre the origin. The sides of this hexagon are alternately the front faces and 
original boundaries, i.e. Cb, Rb, Fb, Mb, S b , Lb- 

The lifts of the <!> diagonals are easily identified, thus 

(5.3) $ f -[0,l)x{ PF }xiJxLi$ 

where pf G Gb is the midpoint of the side corresponding to Fb and D$ C H 2 is the 
0-fibre diagonal. Similarly 



$ ft = {0} x l F x H x L>$ 

where fj? C Gj is the line through pp, the origin and the midpoint of the side 
representing Lb- 

This proves the lemma with 

(5.4) $ T = {0} x {0} x T$, T$ C H 3 the triple ^-diagonal. 

Now we complete the definition of the triple <!>-space by three more (levels of) 
blow up 



(5.5) Xi = [X^,^ T ]^ft]^st;^ct]^f]^s;^c]- 



From (5.3) and (5.4) it follows that $ft, &st] $ct lift to be disjoint after the blow 
up of $t so the orders of these three blow ups, and the last three, are immaterial. 
However, the order between the last three blow ups and the preceding three is 
important and cannot be arbitrarily rearranged, since for instance $>ft and $i? 
intersect but not transversally, nor is one contained in the other. This space is 
mainly useful for the maps defined on it. □ 
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Proposition 6. For = F, S.C there is a b-fibration 7r| : A,| — > A| fixed by 
the demand that it give a commutative diagramme with the corresponding projection 

(5.6) 



X 3 



x$ 



■x< 



Proof. To define these maps we start with the corresponding maps for the b- 
calculus; the middle maps in ( [5.6] ). These can be constructed using the commutabil- 
ity of blow ups for O D T, we shall take O — F for the sake of definitencss. Then 



(5.7) X 3 = [X 3 ; T; F; S, C] = [X 3 ; F; T; S, C] = [[X 3 ; F];T; S, C] 

Now [X 3 ;F] 

+ X 2 



X x X 2 so there is a commutative diagram with vertical projections. 



X x Xl ■ 



4 



X 2 . 



Then 7if F = j F o /3, (3 : [[X 3 ; F];T; S; C] — ► [X 3 ;F] being the blow down map. 
Thus 7T^ f is defined and is automatically a b-map. We need to show that it is a 
b-submersion and finally a b-fibration. Certainly it is surjective. 

A b-fibration, /, remains a b-submersion when composed with the blow down 
map for blow up of some p-submanifold, M, if, for each point p of the submanifold 
the induced map 



(5.8) 



/ : M — > Fa(/(p)) 



is a b-submersion. Here Fa(g) is the smallest boundary face of the range space 
containing f(p). For any boundary face, M, this condition is automatically satisfied. 
This 'blown up' b-fibration is again a b-fibration, rather than just a b-submersion, 
if f(M) is a boundary hypersurface of the range space, which is to say it is not 
contained in a boundary face of codimension 2. Since this is immediately clear for 
the blow ups is the definition of (3, and hence tt% F , the latter map is a b-fibration. 



Now that we have fixed the central vertical maps in (5.6) we proceed to the 
definition of the 7r|, , again taking O = F for definiteness sake. In (5.5) the 

submanifolds $st, $ct and $ F are disjoint, so the order can be changed to 



X% = [A b 3 ; $ T ; $ FT ; $ F ] $'], = $St; $ct; $s; $ 
Similarly <&t C $ft and $t is disjoint from $f so 
(5.9) X 3 = [At; $ FT ; $ F ; $"], $" = $ T ; 



c- 



Consider again the definition, (5.1), of X 3 , reorganized as in (5/7). The submanifold 
S and C are disjoint from <&ft and $f so ( |5.9| ) can be written 

(5.10) 



X 3 = [XxI t 2 ;T;$ FT ;$ F ;fl], R = S;C;$". 
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In X x X£ the submanifold X x $ lifts to $_f under the blow up of T and $ ft is 
the lift, in fact preimage, of <p(X x $)flT under blow up of T. Thus (5.10) can be 
commuted to 

X|= [lxI t 2 ;(Tn(Ix$));T;f f ;fl]. 
The second and third blow up are disjoint so in fact 

(5.11) X% = [X x Xl; (X x $); Tflflx $); T; i?] 

The final rearrangement here is of two cleanly intersecting submanifolds with are 
blown up with there intersection, this can be accomplished by blowing up either of 
them first, then the inte rsect ion, then the other, with the same final result. 
The first blow up in ( 5.11 ) is the definition of X| so 

(5.12) X*=[X xXl;Tn(X x$);T;R] 
allows the blown up projection in ( |5.6| ) to be defined by 

nl F =j F -i>,lF-X xXl — > X% 



being the projection, with ip the collective blow up of R in (5.12). 

To show that 7r|, f , and hence by symmetry each of the 7rjj, , is a b-fibration it 
is only necessary to check the two conditions involving ( |5.8| ) for each of the blow 
ups in ip. In fact, using the product structure in ( |5.3| ), etc., this is straightforward 
so the details are omitted. Suffice it to say that the fibration can be eliminated 
directly and the case 4> = Id is then simpler to analyze. □ 

We further augment Proposition ^| by considering the relationship between these 
maps and the lifted diagonals. 

Lemma 11. The lifted diagonals, defined as the closures in X& of the diagonal 
D C X°xX° in each of the three possible positions, are p- submanifolds -D$,s, 
D^^c as is the lifted triple diagonal -D$,t- Each of the maps 7r|, q is transversal to 
D<s>,0' , for O' ^ O and maps 

D<e>,t = D^ 0l n £><£>, Oa, Oi ^ 2 

diffeomorphically onto D$ £ X\. 

Proof. These results are immediate away from any boundaries. The transversality 
of 7t| F , say, to D^ s follows by lifting V<s,(X) from the left factor. This is in the 
null space of the differential of 7r| F and lifts to be transversal to -D$.s, essentially 
by Lemma [|. Thus 7r| F maps Dq, s diffeomorphically onto X^, and hence embeds 
the submanifold -D^t C -D*,s as D<j, C X%. □ 

With these maps and transversality results available the composition formula is 
now straightforward. 

Theorem 2. For any vector bundles E, F, G over a compact manifold with bound- 
ary X , and fibred boundary structure <J>, 

*%(X; F, G) o *%'(X; E, F) C *™ +m '(X; E, G) 

and both the symbol map ( |3.9| ) and normal operators 

^(X;E.F) — {v) _^{dX;E,Fl 

V = * NY, of Proposition ^ are multiplicative. 
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Proof. The composition is well defined by Proposition ^. □ 

6. Mapping properties 

To deduce the L 2 boundedness of the operators of order zero we shall use an 
argument due to Hormander |^] which depends on the existence, within the calculus, 
of an approximate square root of a positive elliptic element. 

Proposition 7. If B G ^^(X) is formally self-adjoint, for some smooth positive 
density on X, then for C > sufficiently large 

C + B = A* A + R, 
for some A G %%(X) and R G x 00 ^ 00 (X). 

Proof. Since B is formally self-adjoint with respect to the density, v, the indicial 
family B{t, n) consists of operators which are self-adjoint with respect to the bound- 
ary density, defined by v = dx <g> Vq for an admissible defining function x. Thus, for 
C > sufficiently large 

(C + B(T, V ))i €^(8X) 

and from the uniqueness of this positive square root it is the indicial family of some 
A € ty^,(X). Again for C large enough A can be chosen to have 

a (A ) = (C + a (B))i 

as well. Thus, replacing Aq by \{Aq + Aq) we find 

C + B -A 2 e x^(X). 

Proceeding by induction, as in the standard case, one can suppose that Ar k _i) G 
^%(X) has been constructed such that A*^^ — A^_-^ and 

C + B - Af k _ 1} = R k G x k ** k (X). 

Adding an unknown A k G x k ^^ (X) to A( k _^ gives 

C + B - (A {k -i) + A k f =R k - A {k _ 1} A k - A k A {k _ x) - A\ 
= R k - A^ k _ 1) A k - A k A ( ^ k _ 1 ) 

modulo x k+1 ^^ k ^ 1 (X). Thus if A k = x k G k is chosen to satisfy 

(6.1) N(A )N(G k ) + N{G k )N(A ) = N(F k ), F k = x - k R k 

then At k ) — + A k satisfies the inductive hypothesis at the next level. Notice 

that, at the level of the indicial families, (6.1) is indeed solvable, as the linearization 
of the definition of the square root 

(A (t, V ) + Gkir^)) 2 = Mt, v ) 2 +Fk( T , V ), 

Ao(r,rj) being a positive operator for all t, 77. Finally then A can be taken as an 
asymptotic sum of the series defined by the A k . □ 



Theorem 3. Each element P G *ff§(X;E) defines a bounded linear operator on 
L 2 (X;E), defined with respect to a positive smooth density on X. 
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Proof. Since X is compact, boundedness on L 2 is a local property of operators, 
so it suffices to consider the case E = C by local trivialization. Then applying 
Proposition with B = -P*P shows that, for all u £ C°°(X), 

\\Pu\\ 2 = C\\u\\ 2 - \\Au\\ 2 + (Ru,u) < C\\u\\ 2 + \(Ru,u)\ < C'||u|| 2 , 

where the fact that elements of x 00 ^E'J 00 (X), being smoothing operators, are L 2 
bounded has been used. □ 

Just as the construction of an approximate square root proceeds as in the bound- 
aryless case, with some extra care needed to handle the normal operator, so the 
existence of parametrices for 'fully elliptic' operators is straightforward. 

Proposition 8. If P £ (X ; E , F) is fully elliptic in the sense that its symbol is 
everywhere invertible and its normal operator is invertible on each fibre of <fi, then 
there exits Q 6 \I/J m (X; F, E) satisfying 

PoQ-Id£ x°°$£° pf;.F) andQoP -Ide x°°^^°°(X; E). 

Proof. Using the symbol calculus, Q £ ^^ m (X; F, E) can be chosen to have 

o--m{Qo) = (a m (P))-\ N(Q) = N(P)-\ 

This ensures that PoQ = Id —Ri, with R\ £ x^^ l (X] F). Proceeding inductively 
it can be supposed that Qj £ x 3 ^^" 1 ^ 3 (X; F, E) have been constructed so that 

fc-i 

3=0 

Adding Q k = T k x k £ x k ^ m - k (X;F,E) where a_ m _ fc (T fe ) = (<r ro (P))-V_ fc (Ji fc ) 
and N(Tk) = N(P)~ 1 N(Tk) gives the next inductive step. Then Q can be taken 
to be an asymptotic sum of the Qk- □ 

As in the boundaryless case these basic results easily lead to continuity, com- 
pactness and Fredholm properties on Sobolev spaces. For positive real number m, 
and any I £ K set 

x l H'£(X; E) = {ue x l L 2 {X-E)-Pu £ L 2 {X;E) V P £ $>%(X;E)} 

x l H^ n (X-E) 

= ^u&C-°°{X;E)-u = Y^P i M i , u % ex l L 2 (X;E), P % £*£(X;£)j 

Lemma 12. For these Q-Sobolev spaces 

x l H£(X;E) C x l> H%'(X;E) <=>l>l' and m > rri 

with the inclusion then continuous. The inclusion is compact if and only if I > I' 
and m > m! and each P £ ^'^(X; E, F) defines a continuous linear map 

(6.2) P:x l H^{X-E) — ► x l H^'~ m {X\ F) 

for all I and ml . 
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Proposition 9. Each fully elliptic element, P € 1 i ,m (X; E, F), is Fredholm 



is 



map (6.2) and conversely this condition characterizes the fully elliptic elements. 
The null space of such an operator is contained in C°°(X;E) and there is a com- 
plement to the range in C°°(X;F). 

Proposition 10. If P £ W£(X;E,F) is fully elliptic then P*P+l has a two-sided 
inverse in ^^ 2m {X;E). 

7. Wavefront set 

There is a natural notion of wavefront set associated to the calculus of operators 
&q(X',E). In fact in a certain sense there are two such notions, one associated to 
regularity and the other associated to growth at the boundary. In each case we first 
consider the corresponding notion of microlocal support, or operator wavefront set, 
for the operators before examining the wavefront set of distributions. 

For an embedded submanifold Y of a manifold X the conormal distributions 
introduced by Hormander, I(X, Y), have wavefront set a closed conic subset of the 
conormal bundle to Y in X. Let SN*Y be the boundary of the compactification of 
this bundle, i.e. the quotient of N*Y \ by the ]R + -action. Then 

WF(u) C SN*Y, u e I*(X,Y) 

can also be identified with the cone support of the symbol obtained by transverse 
Fourier transformation of u. This second definition extends directly to the case of 
an interior p-submanifold of a manifold with corners. In particular it applies to the 
lifted diagonal in X$. This allows us to define the 'symbolic' part of the wavefront 
set by 

WF'^(A) = WF(A) c S7V*(Diag ) = *S*X, 

The elliptic subset, Ell™ (A) C WF^(i) is the open subset of *S*X on which the 
symbol of order m has an inverse of order —m. Here we have used the identification 
of the conormal bundle to the lifted diagonal with <S 'T*X. 

Now, the discussion above of the composition of <I>-pseudodifferential operators 
shows that the diagonal singularity of the composite arises from the same operation 
as in the interior case. In particular the standard proof of the microlocality of 
composition shows that 

(7.1) WF'^(AoB) cWF; !ff (4)nWF'^(B), A,B eV%(X;E). 

The construction of parametrices for elliptic operators can also be microlocalized, 
so if K C Ell™ (A) is closed, for a given A £ W£(X;E), then there exists B £ 
^ m (X;E) such that 

(7.2) AoB = Id-R L , Bo A = Id -R R , R L , R R £ ^%{X: E) and 

ifn(WF'^(R L )UWF^ fl ))=8. 

Combining these standard results extended to the <&-calculus leads to an alter- 
native characterization of the operator wavefront set 

Lemma 13. For any A £ &%(X; E) 

(7.3) ( WF' $)CT (A)) C = |J { Ell° (B); B e *%(X; E) and B o A e ^°°(X; E)}. 
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Proof. If p G ®S*X is in the set on the right in ( |7.3| ) then there is some B G 
^%(X]E) which is elliptic at p and such that B o A £ E). Using a mi- 

crolocal parametrix as in (7^) i t fol lows that p ^ WF' $ a (A). The converse inclusion 
follows from the microlocality, (7.1). □ 

We next define the corresponding notion of support, WF$ !(T (u), for any distribu- 
tion u £ C~°°(X). Since operators of order — oo are ignored here we work modulo 
the space 

x-^H^(X) = |J x k Hg>(X), 

feez 

Indeed, 

A £ ^°°(X) => A : C-°°(X) — ► x-°°Hf{X). 

Then we simply define 

WF« iCr («)=P|{Char<»(il);AG*J(X), Au e x-°°H^{X)} c 

Char$(A) = (E11°(A)) C . 

Thus by definition, p £ WF$ )ff (u) if there exists A £ ^(X) which is elliptic at 
p and is such that Au £ x~°° H^(X). As with the standard wavefront set there is 
an alternate characterization in terms of the essential support 

(7.4) (WF$,„(ti)) C = |J {U; U C *S*X is open s.t. 

A £ *° (X), WFi >ff (A) G U => Ait £ x-°°^(X)}. 

This follows by use of the calculus as in the boundaryless case. From ( |7.4| ), or 
directly, the calculus is microlocal for this wavefront set: 

WF^ a (Au) G WF' 4)(T (A) n WF$,,(u), A G *^(X), u G C-°°(X). 

Note also that 

u G C-°°(X) and WF $ , CT (u) = ==> u G aT^^pf). 

Together with this extension of the usual notion of wavefront set we next consider 
related notions at the boundary. First consider the operator wavefront set. This 
will be defined as a subset of the radial compactification ®N*Y of the bundle <S 'N*Y. 
This '$-conormal bundle' to the fibres of the boundary is the space of parameters 
in the normal operators; note that it is a bundle over Y, the base of the fibration, 
and that it is the dual of the bundle corresponding to the Lie subalgebra in (1.2). 
Its lift to dX, ®N*dX = <£*(* N*Y), occurs as the quotient of the part, *T^ X X, of 
the dual of the structure bundle over the boundary by the subbundle 

(7.5) *T*dX = (J T*(j)~ 1 (p) C *T a * x A, *tt : *T* dx X — > *iV*9X, 

pedx 

of the fibre cotangent bundles. The inclusion here is just given by pairing with 
vector fields, which shows ^T*dX to be the annihilator bundle in ^Tq X X of the 
lift of *JVT. 

Now, let y G Y be a point in the base of the fibration of the boundary and 
consider a finite point p G *iV|Y. For any admissible coordinates x, y near y, 
p _ ^( x +v-(y-v) ) f or some fj_ 
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Then we define 
(7.6) 

P i (WI» i8 (A) n *iV*y") +S$X n WF'^ a (A) = and 3 i\) G C°°(X) s.t. 

exp ^Hiijj^^ ^ A+^-jg-g) ^ ; coo(x) _ doo(x) 

V (A, 77) in some neighbourhood of (A, fj), 

where ip G C2°(X), is of the form ip = (f>*ip' on the boundary with i/>'(y) = 1 and ip' 
is supported in the coordinate patch. 

Thus in order that p ^ WF' $ g(A) we first demand that WF' $cr (A) not meet 
lp S^ 1( y ) X. Note that the preimage of p in *Ng X X under projection to ®N*dX 
and then <S 'N*Y meets the sphere bundle at infinity *S*dXX exactly in < ^S'*_ 1(5) X. 
Thus this is the condition that the part of WF^ (T (A) 'lying above' p should be 
trivial. The second part of ([7.5[) implies in particular that the normal operator of 



A should be trivial near p. In fact, in terms of the local representation (3.10) and 



(3.11), it means that the Fourier transform in S and Y of the local kernel should 
vanish in a fixed neighbourhood of the point (A, rj) and y' — y as a function z,z' 
and in the sense of Taylor series in x. The uniformity of the neighbourhood in x is 



important. It follows from the remarks after ( 3.11 ), in particular the polynomial 
dependence of the coordinate transformation, that this condition, of vanishing, is 
independent of coordinates. 

Thus this notion is independent of the choice of coordinates in (|7.6| ). It is clearly 
multiplicative in the usual sense that 

WF^ g (AB) c WF'^(A) n WF^ 9 (B) if A,B G ^%(X). 

There is an importance difference between operators of finite order and those of 
order — oo as regards WF'$ d . Of course, for the latter the condition on WF'^ cr (A) 
in (|7.6| ) is vacuous and then given a point p G <i 'N*Y with a neighbourhood U we 
can always decompose 

(7.7) * $ °°PO 3B = B' + B", B\ B" G $>$°°(X), 

p i WF' $i8 (B"), WF' $ a (B') c U, p G *iv*y. 

Such a decomposition is not in general possible for operators of finite order, since 
for instance the cllipticity of the symbol of B would imply that the indicial operator 
never vanishes. 

To an infinite point p £ ®SNgY there corresponds a 'preimage' T(p) C ®S^X, 
consisting of the intersection 

(7.8) r(p) = cl (^tt-V)) n in $ rx 

Here p' C *iV*F is the open half line corresponding to the point p on the sphere 
at infinity and is the composite of in ( |7.5| ) and the projection from dX 
to Y. Thus r(p) is a closed half-sphere bundle of fibre dimension dimF + 1 over 
4>~ 1 (ir(p)). We define the condition 

(7.9) p £ WF'^ 9 (A) for p G *SN*Y <S=*> I» n WF'j Ji) = and 

(7 n *iV*y) n WF$ 9 {A) = for some open 7 C *A^y with p G 7. 
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Note that (7.6) shows that the analogue of Tip) in case p G ' s 'N*yY is finite is 
*S;- 1(S) X. If p*SN*yY then Tip) D ^S^X. 
The restriction of the conjugated operator 

( x + v(y-y)\ i A f.^ + v(y-y) 

exp —i \ipAexp i 



in (7.6) to the boundary fibre above 7r(p) is the indicial operator, N(A,p), at p. We 
define ellipticity for operators of order m in this boundary sense by 

(7.10) E11%(A) = {pe *A r *Y"; N(A.p)^ 1 exists in 9- m {<f>- 1 (n(p))} 

U{ P e *5iV*r ; T(p) c EVg(A)} c *A^y. 

Then certainly EHf(A) C WF'^ a (A). 

Lemma 14. For any A G ffre set Ell^(A) is open in *N*Y. 

Proof. Certainly if p G EH™ (A) n*7V*y then Ell™ (A) contains a neighbourhood of 
p, since the invertibility of the normal operator is an open condition. So consider 
p G ®SN*Y 'at infinity' and suppose p G Ell™ (A). Since Tip') is compact and 
depends continuously on p' G ®SN*Y it follows that r(p') C EIL^A) for p' in a 
neighbourhood of p. Thus it remains to show that NiA,q) _1 G , I , ~ m (</>~ 1 (7r(g))) 
for 5 £ 7'fl *7V*y for some neighbourhood 7' of p in *7V*Y~. Using the calculus, 
we may construct an operator G G x FJ m (X) such that G o A = Id — _E where 
Tip) fl WF$ i(7 (£) = 0. Shrinking 7' as necessary, it follows that N(E,q) is in 
*-°°(0- 1 (7r(g))) for q G 7' n *iV*y and is rapidly vanishing as g -> *SN*Y in 7'. 
Thus AT(A, g) -1 G *" m (</>" 1 (7r(g))) exists for all g in the intersection of *N*dX 
and some neighbourhood of p in ®N*dX. Thus E11™(A) is open. □ 

The construction in the proof of this lemma can be slightly extended to yield: 

Lemma 15. If p G ®N*Y and A G then p G EUg* (A) i/ and on/y if t/iere 

exists G G #$ m (X) swc/i that p £ WF^ a (Id -A o G), p £ WF$ )9 (Id -G o A). 

Notice that in demanding that A be elliptic at a finite point p G *7V*y we are 
requiring that A be symbolically elliptic on the whole set ^S*^dX C ®S*^dX, 
which is the sphere of the subspace in (7.5) above the point nip), since N(A,p) 
is to be invertible as a pseudodifferential operator of order m on the boundary 
fibre. Correspondingly if p G ®N^Y then the parametrix G may be chosen to 
have WF$ )CT (G) concentrated near tS^^dX C *N*X whereas WF^ a (G) can 
only be concentrated near the fibre *NyY. If p G *5W?y then WF' $)0 .(G) may be 
concentrated near T(p) and again WF$ g(G) may be concentrated near 9 N^Y. 

We now define 

(7.11) 

WF$, a (u) c = { P e *7V*y; 3 Ae p g Ellg(A), Au = w + ^ B,-^, 

i 

u> G C°°(X), Vj G C-°°(X), Bj G *i°°(X), p i WF^(B 3 )} c *N*Y. 

Taking 

Char^(A) = *JV*y \ EU^(A) 
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this can also be written 
(7.12) 

WF$, a ( M ) = f| { Char^(A) U (J WF^^); A e V%(X), B j e with 



Au 



3 

E 

3 



BjVj, for some w G C°°(X), 6 C"°°(X) 



The extra finite sum of terms BjVj is included in ( 7.11 ), and ( 7.12 ), because of the 
non-localizability of WF^ g for operators of finite order. Notice that if B G ^J°°(X) 
has WF$ a (B) concentrated sufficiently close to p £ WF^^fu), so WF^^Bj) n 
WFj(B) = for each j, then B £\ G C°°(X) too. 

Since we are demanding that lie in the 'residual space' at p 



(7.13) n p (X) = {ue C _00 (JC); u = u x + u 2 , u x G C°°(X), 

u 2 e{Be ^°°(X); p i WF'^ id (B)} ■ C-°°(X)} c 



>Hg(X), 



where the • means finite span; this is a considerably finer notion than WF$ jCr (u) 
over the boundary. 



Lemma 16. Ifp G *7V Y, the condition p £ WF^fii) given by fl7.1l| ) is equivalent 
to the existence of m G C°°(X), C G with p <£ WF^ 9 (C), ^ G C-°°(X) 

and Bj G \&$°°(X) for j = 1, . . . , J wit/i p ^ WF^fBj) suc/i i/iat 



(7.14) 



ui 



Proof. The form ( 7.14 ) for u fo llows by applying the parametrix G of Lemma |15| 
to the defining re lation in ( 7.11 ). 

Conversely, if (|7.14|) holds for p G ®N*Y and A G *|P0 is elliptic at p and has 
WF' 4>-(T (A) in a small neighbourhood of ^S^dX, so that WF^(4)nWF^(C) = 
then 

Au = Aui + ^2 AB 3 u 'j + ACu e K P (X), 



since WF$ ^(AC) = 0. This gives (7.11). A similar argument applies if p G *SiV*Y. 



□ 

As already noted, the subtlety with the definition of WF$ (u) above arises from 
the non-localizability of the normal operators. In the particular case of the scat- 
tering calculus, considered in |l5| and p9[ , there is no such difficulty. It is useful 
to relate the general case to this scattering case. 

Lemma 17. Ifip G C°°(X) has support sufficiently close to _1 (y) C dX for some 
point y G Y then there is an open product neighbourhood of supp(i/>) of the form 

[0, e) x xY' xf, Y'c Y, 

consistent with the fibration of the boundary and then for any A G 1 ^^ > 00 (X) 1 ipAij) 
is a smooth right density on F x F with values in the scattering calculus on X' = 
[0, 1] x Y, that is ^^^(X'). Furthermore, this product decomposition allows ®N*Y 
to be identified with SC T Y X' and if B^° SC {X') is supported sufficiently close to the 
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boundary and has WF' SC (B) n SC T* Y X' n WF^ a (C) = 0, where C G *$(A) is 
supported in the product neighbourhood then BoCg p 00 5'^ 00 (X'). 

Proof. The first part follows directly from the definitions of the algebras in terms 
of their kernels on the blown up spaces since locally, in Y, the blow up defining the 
stretched product for the fibred cusp calculus is just the blow up for the scattering 
calculus (i.e. the case that the fibres in the boundary are points) with the fibres 
F x F as factors. 

The composition statement in the second part follows directly from the local 



normal forms (3.10), (3.11). □ 



Despite the complexity of its definition, we may now see that this notion of 
wavefront set has many of the familiar properties. 

Proposition 11. The set WF$(u) = WF s , ff (u) U WF 4 , 8 («) C *S*A U *lV*Y~ is 
closed, is empty only for elements ofC°°(X), satisfies 

WF$, 3 (mi + u 2 ) c WF$(ui) U WF$(u 2 ) 

and is reduced by the application of pseudodifferential operators, A G ^JX, in the 
sense that 

WF*{Au) c WF^iJnWF^u), WF^(A) = WF'$ <a (A) U WF'^ 9 (A). 

Proof. That WF$(«) is closed follows directly from the openness of the elliptic 
sets. The microlocality of pseudodifferential operators, (11), follows directly for the 



interior part of the wavefront set and from (7.14) for the boundary part. Thus, if 
B e &%X and p £ WF$ j a(w) then first applying A to (7.14) and then applying 
Q E ^%X which is elliptic at p but has small support (see the discussion following 
Lemma |l^) gives 

QAu = QAu x + ^2 QABjUj + QACu. 

3 

Here in the last term, QAC G f^™! if WF' $ a (Q) is chosen sufficiently small and 
p WF' $ g (QAC). Thus it can be absorbed as an extra term in the sum and deduce 
that p £ WF' $ g(Au) by ( 7.12j) , The other components of (11) are simpler. 



It remains to show that if WF' $ (u) = then u G C°°(X). From WF $iff (ii) = 
it follows that u G x~°° H^f(X); in particular it is smooth in the interior of X. 
We may localize the support of u to a small set near a boundary point, using the 
microlocality just discussed; thus we may assume that u has small support, in which 
the fibration has a product decomposition. Thus u(x, y, z) is a smooth function of 
z with values in a fixed space x~ N H ~ N (X'), X' = [0, 1)^ x Y as in Lemma [l?]. 
Applying the second half Lemma |l^, it follows that if A G ^sc^' has wavefront 



set concentrated near any point p G SC T Y X' then, applying it to ( 7.14 ) Au(x, y, z) 
is C°° in z with values in C°°(X'), and hence in C°°(X' x F). Applying this to a 
partition of unity in the scattering calculus it follows that u G C°°{X). □ 



Remark 1. The somewhat global (at least on the fibre) condition in (7.11), coming 
in turn from ( 7.10| ), is necessitated by the fact, mentioned above, that one cannot 



freely localize the indicial family. Thus, if A G ^%(X) has indicial family invertible, 
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in the calculus, at any one point p £ * N y Y its indicial family cannot be zero at 
any other point in that fibre, that is, 

p £ *N?X, P £ E11°(A) *iV| £ WF' $)9 (A). 

8. Fibred cusp metrics 

As an application of the discussion above we shall examine the spectrum of the 
Laplacian for a metric of 'exact <&-type'. By this we mean any Riemann metric on 
the interior of X, a manifold with a fibred boundary as in (Q) , which takes the form 

dx 2 hi , 

(8-1) g = — + -+.<? 

ar ar 

for some product decomposition near the boundary X £ [0, e) x x dX with <?y a 
smooth symmetric 2-cotensor on [0, e) xY which is positive definite when restricted 
to {0} x Y (with restriction h) and g' is a smooth symmetric 2-cotensor on X which 
is positive definite when restricted to each fibre over the boundary. The fibration 



<f> and the boundary defining function x in (8.1) together determine a $ structure 
on X. Moreover 



Proposition 12. The Laplacian of a metric (3.1) is a $- differential operator on 
functions or acting on sections of the 4> exterior bundle. 

The metric g is a positive definite metric on the bundle ®TX, smooth and non- 
degenerate up to the boundary. This allows ^T*dX to be identified with the ortho- 
complement of * N*dX in ®Tg X X. Furthermore, the boundary defining function x 
in (8.1) defines a natural section dx/x 2 of <s 'N*dX the orthocomplement of which 
can be identified with the lift of T*Y, by identifying rj-dy with ^§ M -- For each y £ dX 
let A y be the Laplacian on the fibres 4>~ 1 (y) fixed by the metric g' . Let \j(y) be 
the eigenvalues of A y arranged in increasing order, repeated with multiplicity. 

Theorem 4. If u £ C"°°(X; A fe ) satisfies Au - \u £ C°°{X), with A £ C i/ien 
(8.2) A ^ [0, oo) ==> u £ C°°(X), 

A £ [0, oo) WF$(«) £ {q £ *A y aA; 3 A^y) < A s.t. 

(? = s— + - with s + \q\ h = A - Aj{y)j. 
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